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DETAILED ACTION 

1 . The text of those sections of Title 35, U.S. Code not included in this action can be found 
in a prior Office action. 

Response to Amendment 

2. This communication is responsive to the applicant's amendment dated 04/06/2009. The 
applicant(s) amended claims 1 and 17 (see the amendment: pages 2-3). 

The examiner withdrew the previous claim rejection under 35 USC 101, because the 
applicant amended the corresponding claim(s). 

Response to Arguments 

3. Applicant's arguments with respect to the claim rejection under 35 USC 103, have been 
fully considered but they are not persuasive. 

In response to applicant's arguments regarding the prior art rejection (applied to claims 1 
and 17) that combined teachings of Aral and Attwater do not teach "generating call type but use 
existing call types" and the generated/clustered "grammar fragments including call-types" 
(Remarks: page 5-8), the examiner respectfully disagrees with the applicant's arguments and has 
a different view of the prior art teachings and the claim interpretations. 

It is noted that, by reviewing the cited references, claims and previous office action, the 
previous examiner's arguments is still applicable, as least partially, to the response to the new 
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applicant's arguments. It also noted that the issue(s) that does not covered by the following 
examiner's response is directed to the previous examiner's response filed on 01/05/2009. 

It is should be pointed out the rejection is based on the broadest reasonable interpretation 
of the claim(s) in light of the specification, so that the argued/claimed limitation of "call-type" 
can be broadly read on any clustered/classified classes regarding routing objective (real phone 
call or the related logical call), call-type classifier, or call-type itself In this case, Arai discloses 
'clustering phrases into grammar fragments' and 'to generate a collection of grammar fragments' 
(col. 2, lines 13-25) which represent 'meaningfiil phrase clusters' relating/regarding call types, 
tasks or routing objectives (col. 1, line 60 to col. 2, line 5; col. 3, lines 54-60; col. 9, lines 4-23). 
Thus, generating the grammar fragments is properly read on the claimed generating call-types, 
since the grammar fragments are or at least include call-types (also see col. 8, lines 32-35). 
Further, it can be seen that Arai discloses using call-type (narrowed scope referring to some key 
words) itself based on the related probability (Fig.2), which means the call-type is a statistical 
model that needs to be trained before using it. Furthermore, Arai discloses, in the training 
transcriptions, 'call-types assigned to transcriptions in which the fragment is observed' (col. 9, 
lines 4-23) and 'each such utterance is labeled with its associated routing objective (i.e. call- 
type)' (col. 9, lines 4-23), wherein the assigning and/or labeling process can also be read on the 
claimed generating call-types. One of ordinary skill in the art would have recognized that in the 
above assigning/labeling process, if there is no any or a corresponding class (call-type, routing 
objective, or task) registered in the system, the system or human expert would assign (generate) 
one for the transcription or utterance; if there is a corresponding class (existing one), the system 
or human expert would use it (existing one). In addition, it is noted that a speech recognition 
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system with statistical models always needs an initial process (from scratch) to assign, label or 
generate the corresponding classes or models (such as call-type in this case) for the 
corresponding training utterance or transcription, so that the argument suggesting that Arai can 
only use existing call types lacks sufficient evidence and not persuasive. 

For above reasons, the applicant's arguments are not persuasive and the claim rejection is 
sustained. 

Claim Rejections - 35 USC § 103 

4. Claims 1-3, 5-6, 8-11, 13-14 and 16-22 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over ARAI (US 6,173,261) in view of ATTWATER et al. (US 6,839,671) 
hereinafter referenced as ATTWATER. 

As per claim 1, ARAI discloses 'grammar fragment acquisition using syntactic and 
semantic clustering' (title) 'for recognizing and understanding fluently spoken languages' 
(abstract), comprising: 

"collecting a plurality of utterances" (Fig. 9 and col. 9, lines 14-8, 'database (collection) 
of a large number of utterances (collected plurality of utterances)'); 

"generating a plurality of call types, each generated call type being based on a first set of 
utterances selected from the collected plurality of utterances", (col. 2, lines 13-35, 'clustering 
phrases into grammar fragments' that are associated to the utterances, 'generate a collection of 
grammar fragments each representing a set of syntactically and semantically similar phrases' and 
used to 'determine a call classification (a call type)'; Fig. 9 and col. 9, line 1 to col. 10, line 45, 
'a set of candidate phrases (including call types) having a probabilistic relationship with one or 
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more of the set of predetermined routing objectives with which the input speech utterances are 
associated', 'call-type classification (generating call types)'; Fig. 2, also showing call types 
having/associating the training transcriptions (corresponding to the first set of utterances); also 
see the examiner's arguments stated in the above section of "Response to Arguments"); 

"generating a first natural language understanding model using call type information 
contained within said first set of utterances"(col. 2, lines 6-9 and 20-35, 'to utilize these grammar 
fragments (associating corresponding utterances) in language models (interpreted as natural 
language understanding models) for both speech recognition and understanding', 'sahent 
sequences of these fragments may then be automatically acquired, which are then exploited by a 
spoken understanding module to determine a call classification'; Figs. 1 la-1 Ic and col. 10, lines 
30-45, 'as a consequence of this expansion, a fiiUy expanded salient fragment network (also 
corresponding to the first natural language understanding model) is obtained (generated)'); 

"testing said first natural language understanding model" (col. 9, lines 61-67, 'recognition 
language model (natijral language understanding model)', 'the training transcription contained 
7,800 sentences while the test transcription contained 1000 sentences', which implies testing the 
language model); 

Even though ARAl discloses that the grammar fragments formed from candidates 
phrases that generated from the training transcription (based on the testing) can be sorted based 
on call types (col. 6, lines 39-53), ARAJ does not expressly disclose "modifying said plurality of 
call types based on said testing" and "generating a second natural language understanding 
model using said modified plurality of call types". However, the feature is well known in the art 
as evidenced by ATT WATER who discloses 'learning of dialogue states and language model of 
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spoken information system' (title) for creating 'a dialog model' using a training corpus of 
example human-human dialogues (abstract), comprising 'a natural language call steering system' 
in that 'the received speech utterance is analysed by the recognizer with reference to a language 
model' and using 'semantic model to form a semantic classification' that provides classifiers 
according to a predefined set of meanings (corresponding to call types) (col. 3, line 60 to col. 4, 
line 14), and teaches that 'the sentences in supervised training corpus 42 are clustered using 
clustering algorithm' and 'clusters thus generated are manually checked' in which the 
words/phrases can be deleted or substituted (modified) in forming a cluster (col. 6, lines 1-22). 
Therefore, it would have been obvious to one of ordinary skill in the art at the time the invention 
was made to recognize that supervised training with manually checked clusters would provide 
capability of modifying the clusters/classes for the transcribed data so as to form a different 
language model, and to modify ARAI by combining the feature of using a candidate set of 
grammar fragments associating the clustered call-types in the training transcription disclosed by 
ARAI (col. 3, lines 1-60) and the feature of using supervised training and/or manually checking 
(or transcribing) clusters with modifying capabilities, such as deleting or substituting, as taught 
by ATTWATER (col. 6, lines 1-22), so that the call type of the candidate fragments associating 
the utterances/transcription can be manually modified and another fully expanded salient 
fragment network (second natural language understanding model) can be generated, for the 
purpose (motivation) of generating more accurate transcriptions and/or improving call-type 
classification performance for the system (ATTWATER: col. 6, lines 30-31; ARAI: col. 10, lines 
21-22). 
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As per claim 2 (depending on claim 1), ARAI in view of ATT WATER fUrther discloses 
"generating an annotation guide using a second set of utterances which is a subset of said first set 
of utterances" (ATTWATER: Fig. 3 and col. 5, lines 13-14, 'nodes. . . have been annotated with 
operator utterance'; col. 11, lines 33-35, 'each call in the corpus can be annotated according to 
the cluster of each operator utterance in the call', wherein the content of labels 26 in Fig. 3, such 
as 'greeting', can be reasonably interpreted as generated annotation guide as claimed; ARAL 
Fig.l IC also suggests that the utterances corresponding to phrase 'collect call' (or 'collect phone 
call') is a subset of the utterances of the consequence expansion (the model), so that it would 
have been obvious to one of ordinary skill in the art at the time the invention was made to 
combine the teachings from ARAI and ATTWATER by providing generated annotation 
(annotation guide) using a subset of utterances of the consequence expansion, for the purpose 
(motivation) of generating more accurate transcriptions and/or improving call-type classification 
performance for the system (ATTWATER: col. 6, lines 30-31; ARAI: col. 10, lines 21-22)). 

As per claim 3 (depending on claim 1), ARAI in view of ATTWATER further discloses 
"generating call type data using at least one of data clustering, relevance feedback, string 
searching, data mining, and active learning tools" (ARAI: Fig. 9, 'grammar fragment (data) 
clustering'; ATTWATER: col. 5, lines 61-65, 'dynamic progranmiing (DP) match (string 
searching)'). 

As per claim 5 (depending on claim 1), ARAI in view of ATTWATER further discloses 
"said first natural language understanding model is frained using a first text file containing 
utterances contained within said first set of utterances and a second text file containing call types 
assigned to said utterances in said first text file" (ARAI: Fig. 9 and col. 9, line 4 to col. 10, line 
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45, wherein the 'database' with labeled utterances and training transcriptions necessarily include 
text file/table (first text file) linking (containing) the corresponding utterances, and the phases 
(text) classified with call types are also necessarily stored in a file or table (second text file) and 
linked (assigned) to the corresponding utterances; also see Figs. 7A-7C and 1 lA-1 IC). 

As per claim 6 (depending on claim 1), ARAI in view of ATT WATER fiirther discloses 
"said natural language understanding model is tested using a subset of said first set of utterances" 
(ARAI: Fig. 9, 'test speech utterance' and 'input speech'). 

As per claim 8 (depending on claim 1), ARAI in view of ATT WATER fiirther discloses 
"said first natural language understanding mode! is created prior to an annotation guide" 
(ATTWATER: Fig. 3, wherein the content of labels 26, such as 'greeting', is interpreted as 
generated annotation guide; col. 11, lines 33-35, 'once the sentences in the training database 
have been clustered . . .each call in the corpus can be annotated according to the cluster of each 
operator utterance in the call', which suggests the model is created prior to the annotation 
(guide)). 

As per claims 17-20, the rejection is based on the same reason described for claims 1-2 
and 5-6, because it also reads on the limitations of claims 1-2 and 5-6 respectively. 

5. Claims 4 and 7 are rejected under 35 U.S.C. 103(a) as being unpatentable over ARAI in 
view of ATTWATER as applied to claim 1, and fiirther in view of MAES et al. (US 
2003/0088421) hereinafter referenced as MAES. 

As per claim 4 (depending on claim 3), even though ARAI in view of ATTWATER 
discloses generating call types, as stated above, ARAI in view of ATTWATER does not 
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expressly disclose "using a graphical user interface (GUI)." However, the feature is well known 
in the art as evidenced by MAES who discloses 'application that supports multi-modal', 
'conversational applications' utilizing 'NLU (natural language iinderstanding)', 'multi-modal 
interactive dialog comprises modalities such as speech, visual (GUI). . .and a combination of such 
modalities (e.g. speech and GUI)' (p(paragraph)46); and 'multi -modal browser application 
comprise a GUI browser' (p73). Therefore, it would have been obvious to one of ordinary skill 
in the art at the time the invention was made to modify ARAI in view of ATTWATER by 
combining the feature of generating call types as stated for claims 1 and 3, with feature of 
supporting multi-modal applications including using GUI, as taught by MAES, for the purpose 
(motivation) of better disambiguating and understanding the user's intention and/or displaying 
the related presenting and updating information (MAES: p46, p244). 

As per claim 7 (depending on claim 1), the rejection is based on the same reason 
described for claim 4, because the claim recites the same or similar limitation(s) as claim 4. 

Conclusion 

6. THIS ACTION IS MADE FINAL. Apphcant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 CFR 
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1 .136(a) will be calculated from the mailing date of the advisory action. In no event, however, 
will the statutory period for reply expire later than SIX MONTHS from the mailing date of this 
final action. 



7. Please address mail to be delivered by the United States Postal Service (USPS) as 
follows: 

Mail Stop 

Commissioner for Patents 

P.O. Box 1450 

Alexandria, VA 22313-1450 
or faxed to: 571-273-8300, (for formal communications intended for entry) 
Or: 571-273-8300, (for informal or draft communications, and please label 
"PROPOSED" or "DRAFT") 

If no Mail Stop is indicated below, the line beginning Mail Stop should be omitted from 



Effective January 14, 2005, except correspondence for Maintenance Fee payments. 
Deposit Account Replenishments (see 1.25(c)(4)), and Licensing and Review (see 37 CFR 5.1(c) 
and 5.2(c)), please address correspondence to be delivered by other delivery services (Federal 
Express (Fed Ex), UPS, DHL, Laser, Action, Purolater, etc.) as follows: 

U.S. Patent and Trademark Office 

Customer Window, Mail Stop 

Randolph Building 

Alexandria, VA 223 14 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Ql HAN whose telephone number is (571)272-7604. The 
examiner can normally be reached on M-TH:9:00-19:30. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richemond Dorvil can be reached on (571)-272-7602. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for pubhshed applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



QH/qh 

June 25, 2009 
/Ql HAN/ 

Primary Examiner, Art Unit 2626 



